Strong Consistency of Multivariate Spectral Variance Estimators in Markov Chain Monte Carlo
نویسندگان
چکیده
Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC community. We present a class of multivariate spectral variance estimators for the asymptotic covariance matrix in the Markov chain central limit theorem and provide conditions for strong consistency. We examine the finite sample properties of the multivariate spectral variance estimators and its eigenvalues in the context of a vector autoregressive process of order 1.
منابع مشابه
Batch Means and Spectral Variance Estimators in Markov Chain Monte Carlo
Calculating a Monte Carlo standard error (MCSE) is an important step in the statistical analysis of the simulation output obtained from a Markov chain Monte Carlo experiment. An MCSE is usually based on an estimate of the variance of the asymptotic normal distribution. We consider spectral and batch means methods for estimating this variance. In particular, we establish conditions which guarant...
متن کاملA Monte Carlo estimation of the entropy for Markov chains
Abstract. We introduce an estimate of the entropy Ept(log p ) of the marginal density p of a (eventually inhomogeneous) Markov chain at time t ≥ 1. This estimate is based on a double Monte Carlo integration over simulated i.i.d. copies of the Markov chain, whose transition density kernel is supposed to be known. The technique is extended to compute the external entropy Ept 1 (log p), where the ...
متن کاملJudging Mcmc Estimators by Their Asymptotic Variance
The expectation of a function can be estimated by the empirical estimator based on the output of a Markov chain Monte Carlo method. We review results on the asymp-totic variance of the empirical estimator, and on improving the estimator by exploiting knowledge of the underlying distribution or of the transition distribution of the Markov chain.
متن کاملMonte Carlo error estimation for multivariate Markov chains
In this paper, the conservative Monte Carlo error estimation methods and theory developed in Geyer (1992a) are extended from univariate to multivariate Markov chain applications. A small simulation study demonstrates the feasibility of the proposed estimators.
متن کاملMultivariate initial sequence estimators in Markov chain Monte Carlo
Markov chain Monte Carlo (MCMC) is a simulation method commonly used for estimating expectations with respect to a given distribution. We consider estimating the covariance matrix of the asymptotic multivariate normal distribution of a vector of sample means. Geyer [9] developed a Monte Carlo error estimation method for estimating a univariate mean. We propose a novel multivariate version of Ge...
متن کامل